Recent studies have shown that using an external Language Model (LM) benefits the end-to-end Automatic Speech Recognition (ASR). However, predicting tokens that appear less frequently in the training set is still quite challenging. The long-tail prediction problems have been widely studied in many applications, but only been addressed by a few studies for ASR and LMs. In this paper, we propose a new memory augmented lookup dictionary based Transformer architecture for LM. The newly introduced lookup dictionary incorporates rich contextual information in training set, which is vital to correctly predict long-tail tokens. With intensive experiments on Chinese and English data sets, our proposed method is proved to outperform the baseline Transformer LM by a great margin on both word/character error rate and tail tokens error rate. This is achieved without impact on the decoding efficiency. Overall, we demonstrate the effectiveness of our proposed method in boosting the ASR decoding performance, especially for long-tail tokens.

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps.

Air pollution is a crucial issue affecting human health and livelihoods, as well as one of the barriers to economic and social growth. Forecasting air quality has become an increasingly important endeavor with significant social impacts, especially in emerging countries like China. In this paper, we present a novel Transformer architecture termed AirFormer to collectively predict nationwide air quality in China, with an unprecedented fine spatial granularity covering thousands of locations. AirFormer decouples the learning process into two stages -- 1) a bottom-up deterministic stage that contains two new types of self-attention mechanisms to efficiently learn spatio-temporal representations; 2) a top-down stochastic stage with latent variables to capture the intrinsic uncertainty of air quality data. We evaluate AirFormer with 4-year data from 1,085 stations in the Chinese Mainland. Compared to the state-of-the-art model, AirFormer reduces prediction errors by 5%~8% on 72-hour future predictions. Our source code is available at https://github.com/yoshall/airformer.

Salient object detection (SOD) focuses on distinguishing the most conspicuous objects in the scene. However, most related works are based on RGB images, which lose massive useful information. Accordingly, with the maturity of thermal technology, RGB-T (RGB-Thermal) multi-modality tasks attain more and more attention. Thermal infrared images carry important information which can be used to improve the accuracy of SOD prediction. To accomplish it, the methods to integrate multi-modal information and suppress noises are critical. In this paper, we propose a novel network called Interactive Context-Aware Network (ICANet). It contains three modules that can effectively perform the cross-modal and cross-scale fusions. We design a Hybrid Feature Fusion (HFF) module to integrate the features of two modalities, which utilizes two types of feature extraction. The Multi-Scale Attention Reinforcement (MSAR) and Upper Fusion (UF) blocks are responsible for the cross-scale fusion that converges different levels of features and generate the prediction maps. We also raise a novel Context-Aware Multi-Supervised Network (CAMSNet) to calculate the content loss between the prediction and the ground truth (GT). Experiments prove that our network performs favorably against the state-of-the-art RGB-T SOD methods.

道路网络的图结构对于自动驾驶系统的下游任务，例如全球计划，运动预测和控制至关重要。过去，公路网络图通常由人类专家手动注释，这是耗时且劳动力密集的。为了获得更好的有效性和效率的道路网络图，需要进行自动的路网图检测方法。先前的作品要么是后处理的语义分割图，要么提出基于图的算法以直接预测道路网络图。但是，以前的作品遭受了硬编码的启发式处理算法和劣质最终性能。为了增强先前的SOTA（最新方法）方法RNGDET，我们添加了一个实例分割头，以更好地监督模型培训，并使模型能够利用骨干网络的多尺度功能。由于新提出的方法从RNGDET改进，因此命名为RNGDET ++。所有方法均在大型公开数据集上进行评估。 RNGDET ++在几乎所有度量分数上都优于基线模型。它将拓扑正确性APL（平均路径长度相似性）提高了3 \％。演示视频和补充材料可在我们的项目页面\ url {https://tonyxuqaq.github.io/projects/rngdetplusplus/}中获得。

随着自动驾驶汽车的快速发展，目击者对高清地图（HD地图）的需求蓬勃发展，这些地图（HD地图）在自主驾驶场景中提供了可靠且强大的静态环境信息。作为高清图中的主要高级元素之一，道路车道中心线对于下游任务（例如预测和计划）至关重要。人类注释器手动注释车道中心线高清图是劳动密集型，昂贵且效率低下的，严重限制了自动驾驶系统的广泛应用和快速部署。以前的工作很少探索中心线高清图映射问题，这是由于拓扑复杂和道路中心线的严重重叠问题。在本文中，我们提出了一种名为CenterLinedet的新方法，以自动创建Lane Centrine HD地图。通过模仿学习对CenterLinedet进行训练，并可以通过使用车辆安装的传感器进行迭代有效地检测到车道中心线的图。由于应用了类似DITR的变压器网络，CenterLinedet可以处理复杂的图形拓扑，例如车道相交。在大型公开数据集Nuscenes上评估了所提出的方法，并通过比较结果很好地证明了CenterLinedet的优势。本文附有一个演示视频和一个补充文档，可在\ url {https://tonyxuqaq.github.io/projects/centerlinedet/}中获得。

量子系统的许多基本属性都被其哈密顿和基态捕获。尽管基态制备（GSP）具有重要意义，但对于大规模的哈密顿人来说，这项任务在经典上是棘手的。发挥现代量子机的力量的量子神经网络（QNN）已成为征服此问题的领先协议。因此，如何增强QNN的性能成为GSP中的关键主题。经验证据表明，具有手工对称的Ansatzes的QNN通常比不对称Ansatzes的QNN具有更好的训练性，而理论解释却没有被探索。为了填补这一知识差距，我们在这里提出了有效的量子神经切线核（EQNTK），并将这一概念与过度参数化理论联系起来，以量化QNNS趋向全球最佳OPTA的融合。我们发现，对称Ansatzes的进步归因于其较大的EQNTK值，其有效尺寸很小，这要求很少的参数和量子电路深度达到过度参数化的制度，允许良性损失景观和快速收敛。在EQNTK的指导下，我们进一步设计了一种对称修剪（SP）方案，可以自动从过度参数化和不对称的对称的ANSATZ量身定制对称的ANSATZ，以极大地提高QNN的性能，而汉密尔顿的显式对称信息是不可用的。进行了广泛的数值模拟，以验证EQNTK的分析结果和SP的有效性。

联合学习是用于培训分布式，敏感数据的培训模型的流行策略，同时保留了数据隐私。先前的工作确定了毒害数据或模型的联合学习方案的一系列安全威胁。但是，联合学习是一个网络系统，客户与服务器之间的通信对于学习任务绩效起着至关重要的作用。我们强调了沟通如何在联邦学习中引入另一个漏洞表面，并研究网络级对手对训练联合学习模型的影响。我们表明，从精心选择的客户中删除网络流量的攻击者可以大大降低目标人群的模型准确性。此外，我们表明，来自少数客户的协调中毒运动可以扩大降低攻击。最后，我们开发了服务器端防御，通过识别和上采样的客户可能对目标准确性做出积极贡献，从而减轻了攻击的影响。我们在三个数据集上全面评估了我们的攻击和防御，假设具有网络部分可见性的加密通信渠道和攻击者。

VQA是一项雄心勃勃的任务，旨在回答任何与图像有关的问题。但是，实际上，由于用户的需求不断更新，并且该系统必须实施新功能，因此很难为所有人构建这样的系统。因此，持续学习（CL）能力是开发高级VQA系统的必要条件。最近，先锋工作将一个VQA数据集分为不相交的答案集以研究此主题。但是，VQA上的CL不仅涉及标签集的扩展（新答案集）。在将VQA系统部署到新环境（新的视觉场景）以及如何回答需要新功能的问题（新问题类型）时，研究如何回答问题至关重要。因此，我们提出了Clove，这是一个在视觉问题答案上连续学习的基准，其中包含上述两个CL方案的场景和功能收入设置。在方法论方面，VQA和分类的CL之间的主要区别在于，前者还涉及扩大和防止忘记推理机制，而后者则集中在班级表示上。因此，我们提出了一种为CL上量身定制的基于无数据的基于Real-DATA的基于VQA上的方法，称为场景图作为符号重播的提示。它使用一段场景图作为提示，它可以重播伪场景图，以表示过去的图像以及相关的QA对。还提出了一个统一的VQA模型来利用当前和重播数据来增强其质量检查能力。最后，实验结果揭示了丁香的挑战，并证明了我们方法的有效性。数据集和代码将在https://github.com/showlab/clvqa上找到。

在存在未衡量的混杂因素的情况下，我们解决了数据融合的治疗效应估计问题，即在不同的治疗分配机制下收集的多个数据集。例如，营销人员可以在不同时间/地点为相同产品分配不同的广告策略。为了处理由未衡量的混杂因素和数据融合引起的偏见，我们建议将观察数据分为多组（每个组具有独立治疗分配机制），然后将组指标显式地模拟为潜在的组仪器变量（LATGIV），将其模拟为实施基于IV的回归。在本文中，我们概念化了这种思想，并开发了一个统一的框架，以（1）估计跨群体观察到的变量的分布差异； （2）对不同治疗分配机制的LATGIV模型； （3）插入latgivs以估计治疗响应函数。经验结果证明了与最新方法相比，LATGIV的优势。